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ABSTRACT 


This thesis analyzes the Sailors’ aeademic suceess in the TA-funded eourses taken in the 
Navy College Program Distanee Learning Partnership (NCPDLP) Program partner 
institutions. This study also investigates the effeet of institutional charaeteristies on the 
aeademie success of students. The data files obtained from Navy Education and Training 
Command (NETC) and Integrated Postsecondary Education Data System are merged to 
generate the data set used in the analysis. The analysis suggests that Sailors who take 
courses via Distance Teaming (DE) methods in the NCPDEP partner schools have lower 
course completion rates and lower grade point averages than Sailors who take DE courses 
in other types of schools. The analysis also indicates that Sailors who enroll in private 
for-profit schools receive higher grades in TA-funded courses than Sailors who enroll in 
public or private nonprofit schools. 
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1. INTRODUCTION 

A. PURPOSE OF THE STUDY 

This study will investigate the eharaeteristies of institutions that participate in the 
Navy College Program Distance Learning Partnership (NCPDLP) Program. It will 
examine the effects of institutional characteristics on the success of the Sailors who take 
classes via tuition assistance (TA) in terms of course completion and grade point average. 
A detailed analysis of course-level data from the Navy’s TA program will be conducted 
to find out afore mentioned effects. 

B. BACKGROUND 

The Navy provides financial assistance to Sailors who wish to enroll in college- 
level classes via a program called Tuition Assistance. Through this program, Sailors take 
courses in an off-duty status in a college, university or vocational institution. The 
regional or national accreditations of the schools in which Sailors take courses are 
recognized by the U.S. Department of Education. The Navy’s TA program pays for both 
classroom and distance learning courses (U.S. Navy, 2012). 

In an effort to make it easy for Sailors to use Tuition Assistance (TA), since 1999, 
the Navy has collaborated with some institutions to provide Sailors with a rating-relevant 
academic education via Distance Learning (DL) methods (McLaughlin, 2010). Starting 
the program with 5 schools in 1999, the Navy is now partnering with 43 institutions as of 
February 2012 (U.S. Navy, 2012). There has been no study conducted on the 
effectiveness of the NCPDLP Program. This study will analyze the success of Sailors in 
the courses taken in NCPDLP schools. 

In the analysis, the method of instruction will also be taken into account to 
separate the effect of DL and traditional methods used in TA courses. Previous studies 
investigated the effects of individual characteristics on Sailors’ success in the courses 
taken via TA. This thesis will incorporate institutional characteristics that are likely to 
influence students’ academic success. 
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Institutional characteristics affect students’ sueeess in eourses, whether it is taught 
via DL or traditional methods. Some of the features of the schools that offer Sailors 
eourses will be taken into aeeount to find out if they have a systematie relationship with 
student success. For example, the reeent rapid growth of for-profit eolleges in the United 
States has fueled several eontroversies about the quality of edueation reeeived in these 
institutions. The thesis examines differences in student aeademie performanee between 
for-profit sehools and public or private nonprofit sehools. 

C. RESEARCH QUESTIONS 

The primary researeh questions dealt with in this thesis are: 

• What is the effeet of taking TA-supported eourses in NCPDLP sehools on 
the aeademie sueeess of Sailors? 

• Do NCPDLP schools do better in eourses taught via DL methods or via 
traditional instruetional methods? 

• How do the institutional characteristies affect Sailors’ academic success in 
TA courses? In particular, does student sueeess differ in for-profit 
postsecondary institutions? 

The seeondary researeh questions are presented below: 

• Does Sailors’ sueeess differ by eourse subjeet? 

D. SCOPE, LIMITATIONS, AND ASSUMPTIONS 

The eourse-level data are provided by Naval Edueation and Training Command. 
Data on institutions are obtained from the National Center for Edueational Statistics 
Integrated Postseeondary Edueation Data System (IPEDS). In an effort to merge these 
two data files, a new data file eonsisting of the names and identifieation eodes of the 
institutions is generated by hand using a spreadsheet. 

Institutions partnered with the Navy via the NCPDEP Program are identified and 
eoded by hand using the information provided at the Navy College Center web site. 
There were five NCPDEP partner schools until 2004. In 2004, the number of schools 
increased to 17 partners. 
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The sample consists of courses taken by enlisted personnel between 1994 and 
2007 in schools offering undergraduate education. Since NCPDLP partner institutions are 
chosen by the Navy among the ones that offer two or more years of education, courses 
taken in schools that offer less than two years of education are dropped from the analysis. 

This study assumes that schools partnering with the Navy via the NCPDLP 
Program are different from the institutions that do not partner with the Navy. The Navy 
and the schools that participate in NCPDLP Program sign a Memorandum of 
Understanding (MOU). By accepting the terms and conditions the Navy declares, partner 
schools are assumed to differ from other schools. This thesis tests whether these 
differences impact 

E. ORGANIZATION 

This thesis includes five chapters. Chapter II of the thesis gives detailed 
information on the history and background of NCPDLP program. Then, the literature on 
method of instruction. Distance Learning (DL) versus traditional methods, is reviewed 
briefly. Highlights of the studies conducted on the impact of DL methods on course 
completion and performance conclude the chapter. 

The data used in the analysis is discussed in Chapter III. In this chapter, 
dependent and independent variables are described briefly. Summary statistics of the 
analysis variables are also provided to better understand the data. The summary statistics 
provide a basis to the multivariate regression models introduced in the next chapter. 

The methodology of the analysis and the fixed effects multivariate model used in 
the thesis is discussed in Chapter IV. The regression model provides us with an 
understanding of the systematic relationships between the dependent and explanatory 
variables. Finally, regression results on the successful completion of courses and course 
grade point averages (GPA) are reported. Findings of the study are presented in this 
chapter. 

Conclusions and recommendations are presented in Chapter V. 
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II. BACKGROUND AND LITERATURE REVIEW 


A. NAVY COLLEGE PROGRAM DISTANCE LEARNING 

PARTNERSHIP (NCPDLP) 

The Navy College Program Distance Learning Partnership (NCPDLP) was 
introduced in 1999 as a pilot program partnering with five other Distance Learning (DL) 
programs. The programs offered were directly related to a Sailor’s rating or job field. 
Since then, the NCPDLP has been revamped to offer Sailors more choices (McLaughlin, 
2010 ). 

In 2004, more degrees were added to the program in order to cover all of the 
Navy’s ratings. Thus, the program allowed a Sailor to pursue a career-enhancing degree 
in the Sailor’s career field. In that same year, the Navy partnered with 17 academic 
institutions offering 96 degrees, each of which was linked to one or more Navy enlisted 
ratings (McLaughlin, 2010). 

In 2007, the program was revamped to offer Sailors more flexibility. Since then. 
Sailors have not been required to take courses that are directly related to their career field. 
In 2010, 34 fully accredited academic institutions participated in the program. They 
offered 264 degree programs at the associate and baccalaureate level. A Memorandum of 
Understanding (MOU) about the features of the program must be signed by the 
participating schools (McLaughlin, 2010). As of February 2012, the Navy is currently 
partnered with 43 institutions (U.S. Navy, 2012). A complete listing of schools can be 
found in Table 1. 

According to the information given on its Internet site, the Navy College Program 
(NCP) has developed partnerships with colleges and universities to provide rating¬ 
relevant degrees via distance learning to Sailors everywhere (U.S. Navy, 2012). These 
education partners offer associate and bachelor’s degree programs. In order to enable 
Sailors to pursue a degree from any location, courses are also offered via distance 
learning. The Navy College Program Distance Learning Partnership (NCPDLP) Schools 
aim to accommodate the Sailor’s mobile lifestyle and goals with rating-relevant degree 
programs (U.S. Navy 2012). 
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B. DISTANCE LEARNING VS. TRADITIONAL EDUCATION 

Hogan (1997) conducted a study to compare the success rates of students who 
take distanee learning elasses and traditional courses at South Carolina’s Teehnical 
College of the Low country. In this study, the average grades, eompletion rates, and 
withdrawal rates of students in 11 courses taught in distance-learning seetions were 
eompared to success rates of the same eourses, taught by the same instructor, in 
traditional settings the previous fall. Hogan found that students taking distanee learning 
courses had higher grades and course completion rates, compared to those taking 
traditional courses (Hogan, 1997). 


Table 1. NCPDLP List of Participating Institutions 
(After Navy College Center, 2012) 


Name of the Sehool 

Name of the Sehool 

American Military University 

Norfolk State University 

Berkeley College 

Old Dominion University 

Bismarck State College 

Olympic College 

Brandman University 

Regent University 

Central Texas College 

Roger Williams University 

Charter Oak State College 

Saint Joseph’s College of Maine 

City University of Seattle 

Saint Eeo University 

Coastline Community College 

San Diego City College 

Columbia College 

Southern New Hampshire University 

Dallas TeleCollege 

Strayer University 

DeVry University 

Thomas Edison State College 

ECPI University 

Tidewater Community College 

Empire State College 

Trident Teehnical College 

Excelsior College 

Trident University International 

Elorida National College 

Troy University 

Elorida State College At Jaeksonville 

University Of Maryland University College 

Eort Hays State University 

University of Oklahoma 
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Governors State University 

University of Phoenix 

Hawaii Pacifie University 

University of the Inearnate Word 

Jones International University 

Upper Iowa University 

Liberty University 

Vincennes University 


McLaughlin (2010) investigated the effect of course-delivery methods on the 
promotion and retention of Sailors who took classes via the Navy’s Tuition Assistance 
Program. He compared the performance of students who took classes via distance 
learning (DL) with those who took elasses via traditional instructional methods. 

McLaughlin (2010) used Navy data on all classes taken through the Tuition 
Assistance (TA) program from 1995 to 2007. His study restriets the data to enlisted 
personnel in pay grades between El and E9 who enrolled in undergraduate college-level 
elasses (McEaughlin, 2010). Aceording to the descriptive statistics provided in the study, 
senior personnel tend to participate in the DE classes at higher rates than junior 
personnel. 

McEaughlin (2010) found that Sailors who enroll in DL classes during their first 
term of service are less likely to be promoted. However, if Sailors enroll in DL elasses in 
the year in which they are eligible for promotion, they are more likely to get promoted 
than Sailors who take face-to-face classes. According to McLaughlin, the “Navy prizes 
the skills and maturity demonstrated by Sailors enrolling in DL classes” (McLaughlin, 
2010). He also found that senior Sailors beeome more homogenous and the method of 
instruction does not affect promotion in these ranks. 

MeLaughlin found that the method of instruetion is assoeiated with the retention 
behaviors of the Sailors. According to the study. Sailors who take DL classes are more 
likely to reenlist than those who participate in traditional classes. The author attributes 
this mainly to the NCPDLP program, whieh is highly advertised to Sailors who are 
interested in enrolling in the TA program. This program is designed to provide the Sailors 
with an opportunity to earn a degree that is related to their rating (MeLaughlin, 2010). 
Because of this relation, it can be inferred that Sailors display a tendeney to stay in the 
Navy by partieipating in this program. 
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C. IMPACT OF DISTANCE LEARNING ON COURSE COMPLETION AND 

PERFORMANCE 

Mehay and Pema (2010) investigated the differenees in the methods of instruction 
using the data on Navy TA classes. They compared the course and job performances of 
the Sailors who take traditional and DL classes in order to find out if there are any 
differences. To overcome selection bias, they formed a natural control group, 
noncompleters, from the TA participants. Because both completers and noncompleters 
have volunteered to enroll in TA courses, they are assumed to have the same 
unobservable individual characteristics that may affect their decision to participate in TA 
(Mehay & Pema, 2010). 

Mehay and Pema (2010) used course completion rates and course grades (GPA) 
as indicators of academic performance of students. The results of their individual fixed 
effects models indicate that taking a DL class is associated with a completion rate that is 
6.5 percentage points lower than that of a traditional class. In the GPA models, the results 
seem to be similar. On a 1.0 to 4.0 scale, taking a DL class is associated with a 
0.26 points lower letter grade. 

Pema and Mehay find that passing a TA course improves reenlistment rates. 
Sailors who take and pass DL courses are more likely to reenlist than ones who take 
traditional courses. Also, they are less likely to make short-term extension contracts. 

Mehay and Pema also found that TA users who take DL courses are more likely 
to be promoted to E-5 before the end of their first term of service. According to the study, 
the effect of taking and passing a traditional class on promotion is statistically 
insignificant (Mehay & Pema, 2010). They argue that the positive effect of taking DL 
courses on promotion may be due to Sailors’ time-management skills. Sailors who take 
DL courses may keep their job performance up by studying after-hours (Mehay & Pema, 
2010 ). 

Mehay and Pema (2010) investigated individual fixed effects, but did not account 
for institutional fixed effects. Sim (2011) used the same dataset to analyze the course 
completion rates and course grades of Sailors by taking institutional fixed effects into 
account. He found that controlling for institutional characteristics lowers course 
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completion rates and eourse grades. Aeeording to his study, unobserved eharaeteristies of 
institutions are likely to be eorrelated and have positive impaet on student sueeess (Sim, 
2011 ). 

D. COMPARISON OF ACADEMIC SUCCESS IN PUBLIC AND PRIVATE 
SCHOOLS 

The reeent rapid growth of for-profit eolleges in the United States has sparked 
several eontroversies. The main issue eoneems the quality of edueation reeeived by 
students in for-profit institutions. Doming et al. (2011) find that students who attended 
for-profit institutions had higher unemployment rates and lower earnings six years after 
entering those programs than students from publie or private nonprofit sehools. Cellini 
and Chaudhary (2011) find that students who eomplete assoeiate’s degrees in private 
two-year sehools (most of whieh are for-profit institutions) experienee earnings gains that 
are similar to those who graduate from publie eommunity eolleges. However, the tuition 
eosts of for-profit sehools are mueh higher than publie sehools suggesting that the eost of 
for-profit sehools to students may outweigh the benefits. 

This eontroversy suggests that the quality of edueation reeeived by a sailor may 
be affeeted by the type of sehool attended by Sailors in the TA program. Thus, this thesis 
also investigates the type of sehool on aeademie sueeess measures to shed some light on 
this issue in military eontext. 
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III. DATA AND VARIABLE DESCRIPTION 


A. INTRODUCTION 

This chapter presents an overview of the data used in the multivariate analyses. 
This chapter also deseribes the variables used in these analyses. Dependent variables and 
key explanatory variables are explored to better understand the relationships among them, 
and summary statistics are presented and discussed. 

B. DESCRIPTION OF COURSE-LEVEL DATASET 

In this study, I used data that were supplied by NETC to McLaughlin (2010) for 
his thesis. The data set contains information on all classes taken via TA from 1994 
through 2007. The original data set eontained 1,837,279 eourse-level observations for all 
aetive-duty personnel. McLaughlin restricted the data to include only undergraduate 
college-level courses taken by enlisted personnel in pay grades El through E9. After this 
restriction, the data set eontained 1,336,878 observations. He also dropped observations 
missing information on key variables such as gender, raee, and TA course type (DL or 
not). The final data set used for the analysis had 1,296,223 observations (MeLaughlin, 
2010 ). 

Sim (2011) obtained further data from the National Center for Educational 
Statistics Integrated Postsecondary Education Data System (IPEDS) on post-secondary 
institutions. The data files downloaded from the IPEDS included information on 
completion, enrollment, finance, edueational offerings, instructional staff salaries, and 
administrative characteristics of all of the post-seeondary institutions from 1994 through 
2007. 

The data files from the IPEDS Data Center included a unique identifier (UNITID) 
for eaeh post-secondary institution. Since there is no matehing identifier between both 
data sets, Sim manually matehed institutions in the two datasets. In the course-level data 
provided by NETC, 1921 different institutions are represented. However, the data 
obtained from the IPEDS Data Center provides information on 1785 different institutions. 
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Therefore, some of the observations did not merge. After dropping the observations that 
could not be merged, the data contains 1,225,273 course-level observations. 

For the purposes of this thesis, the variables drawn from the IPEDS database were 
merged with data from NETC. After merging the two data sets and dropping the 
observations that did not merge correctly, the combined data set consists of 1,225,273 
course-level observations. 

As of Eebruary 2012, there are 43 NCPDEP participant institutions. Since our 
data set stops in 2007, we identified and coded schools for each year between the years 
2000 and 2007. The first institutions participated in the program in 2000. There were 
7 NCPDEP schools until 2004. In 2004, the number of schools increased to 17, with the 
addition of 10 new partner institutions. The number of schools remained the same until 
2008. These institutions are coded in the data as NCPDEP schools, according to the 
information from the IPEDS database. 

C. DESCRIPTION OF VARIABLES 

Table 2 provides the descriptions of variables used in the fixed effects 
multivariate analysis. We use a dummy variable to identify the NCPDEP schools. 
Another dummy variable (DUMDE) is added to the model to account for the effect of 
method of instruction on the success of the Sailors. 

The only individual characteristics added into the model are pay grades of enlisted 
personnel who participate in the TA program. Including pay grades into the model 
controls for the work demands of Sailors. Other individual characteristics, such as 
demographics, are excluded since they do not change over time, and would drop out of 
fixed effects estimations. 

Institutional characteristics are also included in the fixed effects regression model 
to observe their effects on the Sailors’ success in courses taken in TA program. This 
thesis is interested in the effect of duration of education an institution offers on the course 
success. Another point of interest is the type of control under which the institution is. The 
model is set up to see the differential effects of public and private schools’ instructional 
environment on Sailors’ success. 
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Table 2. Variable Deseriptions 


VARIABLE 

DESCRIPTION 

dumncpdlp 

=1 if course taken in an NCPDLP school, = 0 otherwise 

dumdl 

=1 if DL course, = 0 otherwise 

fy94-fy07 

Year dummies 

s course 

=1 if the Sailor is successful, = 0 otherwise 

Spa 

Grade Point Average (0-4) 

el-e9 

Enlisted pay grades 

business 

=1 for Business courses, = 0 otherwise 

math 

=1 for Math courses, = 0 otherwise 

nat science 

=1 for Natural Sciences courses, = 0 otherwise 

phys science 

=1 for Physical Sciences courses, = 0 otherwise 

it 

=1 for IT courses, = 0 otherwise 

humanities 

= 1 for Humanities courses, = 0 otherwise 

english 

=1 for English courses, = 0 otherwise 

misc 

=1 for Miscellaneous courses, = 0 otherwise 

medical 

=1 for Medical courses, = 0 otherwise 

vocational 

=1 for Vocational courses, = 0 otherwise 

law ci 

=1 for Eaw courses, = 0 otherwise 

libfac 

=1 if the school has a library, = 0 otherwise 

Inst 4yr plus 

=1 if the school is for 4 or more years, = 0 otherwise 

public 

=1 if the school is under public control, = 0 otherwise 

private nfp 

=1 if the school is under private nonprofit control, = 0 otherwise 


1. Summary Statistics of Dependent Variables 
a. Grade Point Average 

The data set eontains two variables that indieate the sueeess of Sailors in 
eourses. One of the variables is the grade point average (GPA) assigned on a 0.0 to 
4.0 seale. GPA is used as a dependent variable in the multivariate models to evaluate 
the sueeess of Sailors who receive a letter grade from their courses. In our data set 
1,101,938 observations have a GPA value. 
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Table 3. Course-Level GPA Tabulation by NCPDLP Variable 


GPA 

NCPDLP Schools 

Non-NCPDLP Schools 

0 

11,354 

6 . 39 % 

20,494 

3 . 42 % 

1 

5,721 

3 . 22 % 

12,610 

2 . 10 % 

2 

26,870 

15 . 12 % 

70,832 

11 . 81 % 

3 

57,418 

32 . 31 % 

186,593 

31 . 11 % 

4 

76,333 

42 . 96 % 

309,255 

51 . 56 % 

Total 

177,696 

100 . 00 % 

924,242 

100 . 00 % 

Average GPA 


3.022 


3.207 


Table 3 displays the distribution of grade point averages of eourses— 
aceording to the partieipation of the institutions in the NCPDLP program. Judging by the 
percentages given in Table 3, Sailors who attend NCPDLP schools do slightly worse than 
Sailors who take classes in other institutions. Almost 25% of Sailors get 0, 1.0, or 2.0 in 
terms of GPA in NCPDLP schools, while 17% of Sailors who take classes in other 
institutions get the same grades. In NCPDLP schools, 43% of Sailors get 4.0, which is 
8 percentage points lower than the percentage of their counterparts in non-NCPDLP 
schools. 

Table 4 presents the GPA distribution of courses in NCPDLP schools and 
other schools by method of instruction. According to Table 4, 72% of courses taken via 
DL in NCPDLP schools are completed by Sailors who earn a GPA of 3.0 or 4.0. The 
percentage of Sailors who earn 3.0 or 4.0 in DL courses in other schools is almost 
7 points higher. From the courses taught in traditional instructional settings in non- 
NCPDLP schools, approximately 83% of Sailors receive a GPA of 3.0 or 4.0. This value 
is 4.5 percentage points higher than the percentage of Sailors who receive a GPA of 3.0 
or 4.0 from the courses in NCPDLP schools taken via similar methods. Although it is 
impossible to draw any statistical conclusions from these tables, it can be inferred that 
Sailors do better in non-NCPDLP schools in terms of GPA under both instructional 
techniques. 
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Table 4. Distribution of GPA of Courses Taken in All Sehools by Method of 

Instruetion 


NCPDLP Schools Non NCPDLP Schools 



DL GPA 

Non DL 

GPA 

DL GPA 

NonDL GPA 

GPA 

Freq. 

Percent 

Freq. 

Percent 

Freq. 

Percent 

Freq. 

Percent 

0 

7,933 

8.80 

3,421 

3.91 

6,926 

5.43 

25,419 

3.19 

1 

3,553 

3.94 

2,168 

2.48 

4,437 

3.48 

17,025 

2.14 

2 

13,733 

15.23 

13,137 

15.01 

16,979 

13.31 

102,598 

12.88 

3 

28,430 

31.54 

28,988 

33.11 

40,550 

31.79 

259,396 

32.56 

4 

36,500 

40.49 

39,833 

45.50 

58,661 

45.99 

392,251 

49.24 

Total 

90,149 

100.00 

87,547 

100.00 

127,553 

100.00 

796,689 

100.00 


b. Successful Courses 

Another indieator of aeademie sueeess of Sailors in eourses is measured 
using a binary variable on passing or failing (PASS). If a Sailor eompletes a eourse by 
reeeiving a grade of A, B, C, D, Pass, or Satisfaetory, the binary variable takes on a value 
of 1 (MeLaughlin, 2010). If a Sailor reeeives any grades other than the above, sueh as 
fail, withdrawal or ineomplete, he/she is assumed to have failed the eourse and is eoded a 
zero. 

Table 5 exhibits pereentages of sueeessful eourses by method of 
instruetion in NCPDLP-partieipating institutions and in nonpartieipating sehools. 
Proportions of sueeessful eourses are lower in eourses taken via DL methods in all 
eategories. Unlike the differenee observed in grade point averages, pereentages of 
sueeessful courses are almost the same in NCPDLP schools and other school for classes 
taken via traditional methods. Sailors who take DL courses in NCPDLP schools do worse 
than other Sailors by 2.5 percentage points. 
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Table 5. Percent Distribution of Successful Courses by Method of Instruction 


Observation Percentage of Successful Courses 


Overall 


1,225,273 

87.96% 

Overall DL 


250758 

82.43% 

Overall Non DL 

974515 

89.38% 

NCPDLP 

DL 

105232 

81.05% 

Non DL 

94607 

89.85% 

Non 

DL 

145526 

83.42% 

NCPDLP 

Non DL 

879908 

89.33% 


2. Summary Statistics of Key Explanatory Variables 

Table 6 displays the number of courses taken in NCPDLP-participant and 
nonparticipant schools by method of instruction. A total of 561,973 courses were 
attended by Sailors in NCPDLP schools. This represents 45.87% of all courses. 
According to these numbers, 250,758 courses were taken via DL methods. These courses 
account for 20.47% of all courses taken via the Tuition Assistance Program. DL courses 
are taught both in NCPDLP and non-NCPDLP institutions. About 26.4% of all courses 
taken in NCPDLP schools are delivered via DL. By contrast, DL courses make up only 
15.4% of all courses taken by Sailors in other institutions. 


Table 6. Tabulation of Courses by NCPDLP Participation and Method of Instruction 



DL Course 

Traditional Course 

Total 

Non-NCPDLP School! 

102,359 

560,941 

663,300 

NCPDLP Schools 

148,399 

413,574 

561,973 

Total 

250,758 

974,515 

1,225,273 
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NCPDLP schools are more preferred by Sailors if they ehoose to take DL eourses. 
Alternatively, NCPDLP sehools have better seleetion and availability of DL eourses. As 
seen in the table, this is not the ease for eourses delivered by traditional methods. 


Table 7. Number of Courses by Method of Instruction and Number of DL Courses 

Taken in NCPDLP Sehools 


Year 

DL Courses 

(N umber-Percentage) 

Traditional Courses 

(Number- Percentage) 

Number of DL Courses 
in NCPDLP schools 

1994 

1 

0 . 012 % 

7,860 

99 . 88 % 

- 

1995 

26 

0 . 028 % 

90,137 

99 . 72 % 

- 

1996 

61 

0 . 072 % 

84,327 

99 . 28 % 

- 

1997 

907 

1 . 12 % 

80,995 

98 . 88 % 

- 

1998 

3,010 

3 . 4 % 

85,569 

96 . 6 % 

- 

1999 

4,959 

5 . 32 % 

88,215 

94 . 68 % 

- 

2000 

7,099 

7 . 52 % 

87,360 

92 . 48 % 

740 

2001 

11,203 

11 . 41 % 

86,979 

88 . 59 % 

1,409 

2002 

17,084 

16 . 33 % 

87,525 

83 . 67 % 

2,769 

2003 

26,320 

27 . 09 % 

70,817 

72 . 91 % 

4,462 

2004 

39,101 

36 . 81 % 

67,104 

63 . 19 % 

19,290 

2005 

48,321 

45 . 48 % 

57,917 

54 . 52 % 

26,335 

2006 

27,168 

51 . 81 % 

25,266 

48 . 19 % 

14,048 

2007 

65,498 

54 , 6 % 

54,444 

45 . 4 % 

36,179 

Total 

250,758 

20 . 46 % 

974,515 

79 . 54 % 

105,232 


Table 7 shows the number of eourses taken via DL and traditional methods 
throughout the years. As displayed in the table, the number of DL eourses has increased 
signifieantly since 1994. In 1994, the number of DL eourses was only 1, eonstituting only 
0.012% of all the eourses taken in that year. Until 2006, the number of DL eourses kept 
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increasing, although the number of eourses taken via traditional methods always 
exeeeded the number of traditional eourses. In 2006, for the first time the number of DL 
eourses exeeeded the number of traditional eourses, eomprising 51.81% of all eourses. In 
2007, the pereentage of courses taken via DL rose to 54.6%. 


Table 8. Tabulation of Institutions by Finaneial Control and Duration of Edueation 



Overall 

Overall DL 

Non DL 

NCPDLP 

Non NCPDLP 


Courses 

Courses 

Courses 

Schools 

Schools 

Public 

61% 

49.6% 

64.0% 

76.8% 

58% 

Private Non 

Profit 

32.3% 

31.3% 

32.5% 

23.2% 

34% 

Private For- 

Profit 

6.7% 

19.1% 

3.5% 

0.01% 

8% 

4 Years or 

More 

66% 

76.3% 

63.3% 

64.8% 

66.2% 

2-4 Years 

34% 

23.7% 

36.7% 

35.2% 

33.8% 


Most of the Sailors ehoose to take eourses in publie sehools, according to the 
percentages shown in Table 8. Only 6.7% of all eourses taken by Sailors through TA are 
delivered in private for-profit institutions. Table 8 also shows that most of the eourses are 
taken in institutions that offer at least 4 years of edueation. Thirty-four pereent of overall 
eourses are taken in sehools that offer 2 to 4 years of edueation. Another result that draws 
attention is the proportion of DL eourses taken by Sailors in private for-profit institutions. 
Almost 20% of all DL eourses take plaee in private for-profit schools. 
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It is noteworthy that almost all of NCPDLP partner sehools are either publie or 
private nonprofit institutions. Out of the eourses taken in NCPDLP schools, 76.8% are 
attended in public schools, according to Table 8. The percentage of courses taken in 
public non-NCPDLP schools is 58%. Only .01 percent of the courses taken in NCPDLP 
schools are in private institutions. Out of the courses in Non-NCPDLP schools, 8% are 
taken in private schools. 

As seen in Table 9, the average number of instructors teaching in NCPDLP 
schools is 40 percent more than the number of instructors teaching in non-NCPDLP 
schools. The partner institutions of NCPDLP pay more to their instructional staff The 
average salary of the instructors in NCPDLP schools is $10,000 more than their 
counterparts in other schools. 


Table 9. Financial Information of Institutions 



Overall 

NCPDLP 

Non-NCPDLP 

Mean Number of Instructors 

645.72 

850.56 

608.38 

Average Salary ($) 

$ 49,794.9 

$58,127.13 

$48,223.53 

Funds and Revenues (Million $) 

$118 

$139 

$113 

Instructional Expenses 

$84.2 

$49.6 

$93 

(Million $) 




Scholarship Expenses (Million $) 

$7.47 

$6.15 

$7.8 


According to the table, there is a significant difference between the average 
revenues and expenses of schools in different categories. On average, NCPDLP schools 
collect more revenues and funds than their counterparts that are not part of NCPDLP. 
Non-NCPDLP schools’ instructional and scholarship expenses are much higher than 
NCPDLP schools, on average. Based on this information, it can be concluded that non- 
NCPDLP schools generate less revenues, but spend more money on educational activities 
than NCPDLP partner schools. 
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D. CHAPTER SUMMARY 


This chapter provides the summary statisties of the key variables in order to better 
understand the data. Aeeording to the data, 16.3% of all courses are taken in NCPDLP 
partner institutions. 52% of the eourses taken in NCPDLP partner schools were delivered 
via DL methods between 2000 and 2007. 

The average GPA for the eourses taken in NCPDLP partner sehools was 3.02, 
while it was 3.20 for the eourses that were taken in other institutions. Instead of the 
difference observed in this index, the pereentage of suecessful courses was very elose for 
both types of schools. Non-NCPDLP schools were better by only 3 pereentage points in 
terms of suecessful eourses. 

Examining the data closely using descriptive statisties helps us build the 
econometries model to analyze the causal relationships between the variables. The 
differenees presented in this chapter are not necessarily eausal or statistieally signifieant. 
The next ehapter will investigate these differenees in more depth. 
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IV. METHODOLOGY, MULTIVARIATE MODELS AND 

RESULTS 


A. INTRODUCTION 

This chapter will discuss the estimated effeets of institutional and eourse 
eharaeteristies on the suecessful completion of the courses and grade point averages 
reeeived in those eourses. First, the methodology used in the analysis will be presented. 
Seeond, multivariate models for the sueeessful eourse eompletion analysis will be 
discussed and results will be reported. Finally, multivariate models used to analyze GPA 
will be diseussed and the results obtained from the regressions will be presented. 

B. METHODOLOGY AND MODELS 

Fixed effects regression methods will be used in this analysis. Fixed effeets 
methods help to minimize the bias in estimated eoefficients by dropping the variables that 
do not change over time. Fixed effeets estimator uses a transformation to eliminate the 
unobserved effeets that do not ehange over time, before the estimation. Any time- 
eonstant explanatory variables are removed along with these unobserved faetors 
(Wooldridge, 2009). 

The course completion and GPA models are estimated by using the models 
presented in Table 10. In the analysis, we used five fixed effeets multivariate regression 
models. Full regression results ean be found in Appendix A and Appendix B. The first 
model is the baseline model. In order to see the effeet of DL methods on the Sailors’ 
aeademic sueeess, a dummy variable representing DL added to the model. The primary 
focus of this thesis is to find out how Sailors do in courses taken in NCPDLP partner 
institutions via TA program. Therefore, a dummy variable denoting NCPDLP sehools is 
added to the seeond model. 

As diseussed in Chapter II, the NCPDLP Program is designed to provide Sailors 
with an opportunity to take eourses in partner sehools via DL methods. Therefore, an 
interaction of NCPDLP and DL variables is added to the third model to observe their 
joint effect on the dependent variables. The fourth model is formed by adding interaetion 
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terms for NCPDLP and course subjects. We hypothesize that academic success of Sailors 
is associated with the characteristics of the schools in which they take courses. To test 
this hypothesis, variables representing institutional characteristics are included in the last 
model. 


Table 10. Equations Used to Estimate the Multivariate Fixed Effects 

Model 

Equation 

1 

Yit=a +PiDLi,+p2Subjectit+P3Paygradeit+ p4FYt + ai+ un 

2 

Yit=a + ;ffWCPZ)LP,',+p7DLit+ p 3 Subiecti,+p 4 Pav 2 radeit + PsFY, + aj-l- Ujt 

3 

Yit=a + PiNCPDLPi,+p7DLit + ;ff?f/VCPZ)LP,',A: DLi,)+ p4Subiectit+p3Pav2radeit+ 

p6FYt + ai + Uit 

4 

Yit=a + BiNCPDLPi,+B7DLi,+ B^tNCPDLPi^x DLi4+ Q^SuhiecU+BmCPDlPi^x 

iS'Mfi/ectJ+BfiPavaradeit+BvFYt + aj + Uit 

5 

Yit=a + piNCPDLP„+p 2 DLit+ p 3 (NCPDLPi,x DLiO+ p 4 Subjectit+ pslNCPDLPi, x 

Subiectifl+BfiPavaradeif-i- Orinstitutional Characteristics;, + BsFY, + aj + Uit 


In the equations in Table 10, Yit denotes the dependent variables which are either 

course completion or GPA. Dependent variable coding is displayed in Table 11. 

NCPDLP variable is a dummy variable that represents an institution’s participation in the 

Navy program. The DL binary variable is included in the model to control for the effect 

of method of instruction. We hypothesized that success in the courses taken in NCPDLP 

schools may differ according to the method of instruction. Therefore, an interaction of 

NCPDLP and DL dummy variables is incorporated into the model. Dummy variables for 

course subjects are also included in the equation to observe their independent effects on 

the success of Sailors. We also add interaction variables of course subjects and an 

NCPDLP dummy to test whether the effect of different subjects differs for NCPDLP and 

other schools. Institutional characteristics in the model include the type of the school 

(public, private nonprofit and private for-profit) and the duration of education (2-4 years 

or 4 years or more) offered at the institutions. “Public” and “2-4 years” are the base 
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categories. Fiscal Year dummies (FYt) represent the fiseal year the eourse was taken. 
Year dummies control for the yearly effeets that may influence the Sailors’ sueeess, while 
Ui represents the individual unobserved fixed effeets, sueh as ability and motivation that 
does not ehange over time and “a/,” is the error term. 


Table 11. Dependent Variable Coding 


Grade Received 

Course Completion 

GPA 

A 

1 

4 

B 

1 

3 

C 

1 

2 

D 

1 

1 

F 

0 

0 

Incomplete 

0 

0 

No Grade Assigned 

0 

Dropped 

Pass 

1 

Dropped 

Satisfactory 

1 

Dropped 

Withdrawal 

0 

Dropped 


Some of the individual eharaeteristies are not included in the model. These are 
demographic and other variables that do not change over time. Since these variables do 
not ehange over time, they would drop out in the fixed effects estimation. 

Table 10 displays the eoding of dependent variables. Aeeording to the table, if a 
Sailor gets an F from a eourse, the eourse is eonsidered as not eompleted. Other 
eategories of eourses that are eoded as not eompleted are “No Grade Assigned,” 
“Incomplete,” and “Withdrawal.” GPA is eoded aeeording to the letter grades reeeived 
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from the courses. Since it is very hard to assign a numeric value to them, if an 
observation is coded as “No Grades Assigned,” “Pass,” “Satisfactory,” or “Withdrawal,” 
it is dropped from the data set. 

C. COURSE COMPLETION 

Fixed effects regression results for course completion are displayed in Table 12. 
Full regression results are displayed in Appendix A. According to the results, method of 
instruction has a significant effect on course completion. Holding everything else 
constant, a course taken via DL methods is 7-8 percentage points less likely to be 
completed successfully by Sailors. This result is consistent with the literature discussed in 
Chapter II. 


Table 12. Results for Fixed Effects Regression Models olSuccessful Course 

Completion 


Dependent Variable-Successful Course Completion 


Explanatory Variables 

Model 1 

Model 2 

Model 3 

Model 4 

Model 5 

DL Method 

-0.08 

(0.00)** 

-0.08 

(0.00)** 

-0.07 

(0.00)** 

-0.07 

(0.00)** 

-0.08 

(0.00)** 

NCPDLP Schools 

— 

0.00 

(0.00) 

0.01 

(0.00)** 

0.03 

(0.01)** 

0.05 

(0.01)** 

Interaction of DL and 
NCPDLP 

— 

— 

-0.04 

(0.00)** 

-0.04 

(0.00)** 

-0.03 

(0.00)** 

Institutions Offering 

4 Years of Education 

— 

— 

— 

— 

-0.02 

(0.00)** 

Private Nonprofit 
Schools 

— 

— 

— 

— 

0.07 

(0.00)** 

Private For-Profit 
Schools 

— 

— 

— 

— 

0.11 

(0.00)** 


* significant at 5% level; ** significant at 1% level 


According to the results of the first model. Sailors who take courses via DL 
methods are 8 percentage points less likely to complete them successfully than Sailors 
who take courses via traditional methods. The second model is set up to observe the 
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success of Sailors in the NCPDLP sehools. The variable denoting NCPDLP sehools turns 
out to be statistieally insignifieant. We eannot infer any relationship between NCPDLP 
sehools and aeademie sueeess of Sailors. 

The third model ineludes an interaetion between the DL and NCPDLP variables. 
The eoeffieients of this interaetion are statistieally signifieant at 1% level (see row 3 of 
Table 12). Sailors who take eourses via traditional methods in NCPDLP sehools are 
1 pereentage points more likely to eomplete them sueeessfully, and this eoeffieient is now 
statistieally signifieant. Results also suggest that, DL eourses taken in NCPDLP sehools 
are 4 pereentage points less likely to be eompleted sueeessfully by sailors. 

The fourth model is formed by adding an interaetion term between NCPDLP and 
eourse eategories. The eoeffieient of NCPDLP differs in this model from the previous 
one. The likelihood of sueeessful eourse eompletion of Sailors who take eourses via 
traditional methods in the NCPDLP sehools are assoeiated with a 2 points inerease, 
eompared to the results of the previous model. 

The last model ineludes institutional oharaeteristies. The eoeffieients are 
statistieally signifieant, as seen on the Table 12. The findings show that while NCPDLP 
has a negative effeet on eompletion, this effeet is mainly driven by DL eourses. Sailors 
who take eourses in NCPDLP partner institutions that are taught via traditional methods 
are 5 pereentage points more likely to eomplete those eourses than their eounterparts 
taking elasses in other types of sehools, eeteris paribus. The eoeffieients of the 
(DL*NCPDLP) interaetion term and the DL dummy suggest that DL eourses taken in an 
NCPDLP institution are 3 pereentage points less likely to be eompleted by Sailors, on 
average. These results support the summary statisties exhibited in Chapter III. 

Other important variables added into the model are institutional oharaeteristies. 
These variables denote the type of the institutions, and the length of the eduoation offered 
in an institution. Results suggest that Sailors are 2 pereentage points less likely to 
eomplete a eourse sueeessfully in a sohool that offers 4 years of eduoation than in a 
sohool of 2-4 years of eduoation, holding everything else oonstant. When eompared to 
the eourses delivered in publio sehools, eourses taken in private nonprofit sehools are 
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7 points less likely to be finished by getting a passing grade. Sailors also do better in 
private for-profit schools than in public schools by 11 percentage points, according to 
regression results. 

D. GRADE POINT AVERAGE 

The other dependent variable on which we conducted a fixed effects multivariate 
analysis is GPA. The fixed effects regression is estimated using the same independent 
variables as in the course completion regression. Summary results of the five regressions 
are presented in Table 13. Full regression results are presented in Appendix B. 


Table 13. Fixed Effects Regression Results for Grade Point Average 


Explanatory Variables 

Dependent Variable-GPA 





Model 1 

Model 2 

Model 3 

Model 4 

Model 5 

DL Method 

-0.27 

(0.00)** 

-0.26 

(0.00)** 

-0.23 

(0.01)** 

-0.23 

(0.01)** 

-0.27 

(0.01)** 

NCPDLP Schools 


-0.09 

(0.01)** 

-0.03 

(0.01)** 

0.00 

(0.03) 

0.04 

(0.03) 

Interaction of DL and 
NCPDLP 

— 

— 

-0.13 

(0.01)** 

-0.14 

(0.01)** 

-0.10 

(0.01)** 

Institutions Offering 

4 Years of Education 

— 

— 

— 

— 

-0.12 

(0.01)** 

Private Nonprofit 
Schools 

— 

— 

— 

— 

0.11 

(0.01)** 

Private For-Profit 
Schools 

— 

— 

— 

— 

0.45 

(0.01)** 


* significant at 5% level; ** significant at 1% level 


It is observed in the first model that the GPA of Sailors who take DL courses is 
.27 points lower than the GPA of other sailors, ceteris paribus. The second model 
suggests that courses taken in the NCPDLP schools are associated with a .09 points lower 
GPA. The third model includes an interaction variable of NCPDLP and DL dummy 
variables. According to the results of this model, the GPA of Sailors who take courses via 
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traditional methods in the NCPDLP schools is .03 points lower than the GPA of Sailors 
who take courses via traditional methods in other types of schools. Fourth model is 
generated by adding an interaction between NCPDLP and course categories. The 
coefficient of NCPDP is statistically insignificant in this model. 

The results of the last model show that Sailors who take courses in an NCPDLP- 
participating school receive a GPA that is .04 points higher than Sailors who take courses 
in other types of schools. This result is contrary to the descriptive statistics provided in 
the previous chapter. However, the coefficient of the NCPDLP variable is not statistically 
significant. 

Compatible with the results discussed in the literature review above, Sailors who 
complete courses taken via DL methods receive lower GPA-s. Results of the fixed effects 
multivariate analysis suggest that GPA is 0.27 points lower in non-NCPDLP schools in 
courses delivered via DL methods. In NCPDLP schools there is an additional 0.10 points 
gap on top of the 0.27 points gap observed in DL courses in other types of schools. The 
coefficients of both of these two variables are significant at 1% level. 

Sailors who participate in courses in institutions offering 4 or more years of 
education receive GPAs that are 0.12 points lower than Sailors who take courses in 
schools offering 2-4 years of education. It is possible that schools offering 4 or more 
years of education are more demanding than others. Since NCPDLP schools are chosen 
by the Navy among the institutions offering 2-or-more years of education, schools that do 
not conform to this requirement were dropped from the data. 

Regression results suggest that courses taken in public schools are completed with 
0.45 points lower grades than courses taken in private for-profit schools, ceteris paribus. 
This is almost half a letter grade gap between these two types of schools. Differences in 
GPA are smaller between public and private nonprofit institutions. The difference is 
0.11 points out of 4.0. We can conclude that Sailors are more successful at the courses 
delivered in private for-profit schools. This outcome is consistent with the course 
completion regression results. 
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V. CONCLUSIONS AND RECOMMENDATIONS 


A. CONCLUSIONS 

This thesis analyzes Sailors’ course success and grades received (GPA) in courses 
taken in schools partnering with the Navy in the NCPDLP Program. Methods of 
instruction (DL vs. traditional methods) are also taken into account to observe their 
effects on sailors’ success in courses delivered in different types of institutions. 
Institutional characteristics such as type of institution (name types) and degrees offered 
(2-year or 4-year institutions) are important in predicting course success. Therefore, we 
looked at these features in an effort to understand if there is a systematic relationship 
between institutional characteristics and Sailors’ success in the courses taken in those 
institutions. For example, we analyzed differences in student academic success between 
for-profit and other schools. 

McLaughlin (2010) investigated course-level data to find out the relationship 
between method of instruction and academic success of Sailors. He accounted for 
individual fixed effects in his thesis. Sim (2011), in his term paper, used the same data for 
his analysis. The difference between the two studies was that Sim took into account 
institutional fixed effects. This study is different from the previous ones in two ways: 
First, the data used in this thesis includes institutional characteristics obtained from 
IPEDS data base. Secondly, NCPDLP schools are identified with the help of Sim. These 
two features provided us with an opportunity to do the analysis. 

1. Course Success of Sailors in the NCPDLP Schools 

One of the indicators of Sailors’ academic performance in the courses they take 
via the TA program is successful course completion. Fixed effects regression results 
suggest that Sailors who take classes in NCPDLP partner schools via traditional methods 
are 5 percentage points more likely to complete courses than Sailors who take classes in 
non-NCPDLP institutions. Courses taken via DL methods in NCPDLP schools are 
3 points less likely to be completed successfully, ceteris paribus. The results point out a 
negative correlation between the DL method and successful course completion. 
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Almost 93% of courses taken via TA are pursued in a publie or private nonprofit 
school. Only 6.7% of classes are taken in a private for-profit school. According to the 
results obtained from the fixed effects multivariate model, Sailors are more successful in 
private for-profit or private nonprofit schools than they are in public schools in terms of 
eourse eompletion. Courses taken in publie sehools are 7 pereentage points less likely to 
be eompleted sueeessfully than in for-profit sehools. Sailors are more sueeessful in the 
eourses they take in private for-profit sehools by 11 points as eompared to publie sehools. 

Another institutional eharacteristic that is eonsidered to be an important faetor 
affeeting Sailors’ suecess is duration of the edueation programs. Two different types of 
institutions are eoded in aeeording to the duration of edueation they offer: 

• Institutions offering edueation between 2 years and up to 4 years 
(but 4 years) 

• Institutions offering edueation for 4 or more years 

Aeeording to our analysis, Sailors are 2 pereentage points more likely to eomplete 
eourses sueeessfully in the sehools offering less than 4 years of edueation. 

2. GPA of Sailors in the NCPDLP Schools 

Another indicator of course suecess is the eourse grade received by Sailors. 
Sailors taking eourses in NCPDLP schools receive a GPA that is 0.04 points higher in 
eourses delivered via traditional methods of instruetion. Courses taken via DL methods 
yield negative results eompared to other types of eourses. A Sailor who takes a DL eourse 
in a non-NCPDLP sehool reeeives a GPA that is .27 points lower than other eourses he 
takes in non-NCPDLP sehools. The gap inereases in NCPDLP partner institutions. 
Sailors taking DL eourses inNCPDDLP sehools reeeive a GPA that is .37 points lower. 

When it eomes to the effeet of institutional control on GPA students earn, we 
observe a similar trend as in course eompletion analysis. Sailors who take eourses in 
private for-profit sehools reeeive higher grades than Sailors taking eourses in publie 
sehools by 0.45 points (out of 4.0 points). The GPA earned in publie sehools is .11 points 
lower than the GPA in private nonprofit schools. 
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The longer duration of edueation is assoeiated with a lower GPA, holding 
everything else eonstant. Sailors’ GPAs in courses taken in schools that offer 4 or more 
years of education are 0.12 points lower than GPAs of other Sailors. It can be inferred 
that it is hard to get high grades in schools offering baccalaureate and higher degrees to 
their students. These schools may be more demanding than other schools, making it more 
difficult for Sailors to satisfy their requirements when they take courses in off-duty status. 

NCPDLP schools are associated with lower rates of success. This may be due to 
either more rigorous standards NCPDLP schools have, or their lack of ability to transfer 
knowledge. Both of the hypotheses are valid. We cannot distinguish given the data. 

B. RECOMMENDATIONS 

The NETC database should be updated to include the institutional characteristics. 
Although the data set provided by NETC is sufficient to identify the method of 
instruction used to deliver the courses, NCPDEP identifier is not put in the data. The 
courses taken in NCPDEP partner institutions are identified manually. The NETC data 
files on TA program should include an NCPDLP identifier in order to generate more 
accurate and up-to-date data on the NCPDLP program. 

The Navy partnered with schools to offer Sailors courses via DL method under 
NCPDLP program. But the Sailors are more successful in other types of schools in DL 
courses, according to the analysis conducted in this thesis. More research needs to be 
conducted on the effectiveness of the NCPDLP Program. 

The following areas are recommended for further research on NCPDLP Program: 

• Conduct an analysis of effect of institutional characteristics on course 
success to find out which institutional features foster success. The Navy 
may choose the best schools to partner with. 

• Conduct an analysis of promotion and retention of Sailors who take 
courses in NCPDLP Partner schools. The Navy benefits from the program 
if Sailors taking courses in NCPDLP schools are more successful on the 
job. 
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APPENDIX A. FULL FIXED EFFECTS REGRESSION RESULT 
FOR SUCCESSFUL COURSE COMPLETION 
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APPENDIX B. FULL FIXED EFFECET REGRESSION RESULTS 

FOR GPA 
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